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SUMMARY 


Progress was made this year in several major areas. These include eddy current 
computations, modelling and analysis, design optimization methods, wind tunnel Magnetic 
Suspension and Balance Systems (MSBS), payload pointing and vibration isolation systems, 
and system identification. In addition, another successful International Symposium was 
completed, with the Proceedings edited and published. A 4th Symposium has been planned and 
preparations are well in hand. 

These activities continued and concluded several years of work under this Grant and 
extended previous work on magnetic suspension systems and devices in the Guidance and 
Control Branch. Research accomplishments facilitated the demonstration of several new 
developments in the field of magnetic suspension technology. 

This report concentrates on the period 11/1/95 thru 10/31/96, previous periods having 
already been the subject of progress reports. A summary of all Grant activity is provided at the 
conclusion of this report. 


REVIEW OF WORK DURING THE SUBJECT PERIOD 

(i) Eddy current modelling. The ELEKTRA computer code has been used to calculate 
forces, stored energy, field magnitude and phase, and power losses for magnetic suspension 
(LAMSTF-like) and magnetic bearing (ASPS-like) configurations. Various problems have 
been encountered and overcome, such that an analysis capability suitable for application to the 
LGMSS project has steadily emerged. The current status of this work is reflected in some of 
the publications listed later in this report. 

(ii) Design optimization. An effort to apply state-of-the-art optimization methods and 
computer codes to the magnetic suspension problem has begun. Initial analysis has 



concentrated on small-gap, axisymmetric bearings. It has been shown that optimum designs 
based on maximum force, minimum power, etc., are identifiable and are distinctly different from 
each other. This effort will result in a publication at some point in the future. Analysis will 
then proceed to the large-gap problem, which is more challeging, although some work has 
already been accomplished (by David Cox, LaRC). This work will definately extend beyond 
the conclusion of this Grant. 

(iii) Wind Tunnel Magnetic Suspension and Balance Systems. There appears to be 
continuing interest in this application, both in general, and for a specific test objective, namely 
ultra-high Reynold's number testing. Work on recommissionig the ex-MIT, ex-NASA, 6-inch 
MSBS at ODU continues, but at a very slow pace due to lack of funding and documentation. 
Alternate funding sources for future work are being explored. Two recent presentations 
concerning the wind tunnel application have been made and copies are attached as Appendices 
to this report. 

(iv) Annular Suspension and Pointing System. Work continues at a low level, 
following successful levitation in five degrees-of-ffeedom. The control software has been 
"cleaned up" and some electrical upgrades made to reduce noise. A second joint Proposal for 
future work with LaRC and Boeing has been submitted and would result, if successful, in a 
dramatic increase in effort in this area. 

(v) Symposium support. Support was provided for the organization and execution of 
the 3rd International Symposium on Magnetic Suspension Technology in Tallahassee, Florida. 
This meeting was a great success with no significant problems encountered. A 4th Symposium 
has been planned for late 1997, in Gifu City, Japan. The P.I. will continue to provide support 
for this meeting beyond the end of the current Grant. 

(vi) System Identification. This Section is submitted by the Co-Investigator. 



FINAL REPORT 


IDENTIFICATION AND CONTROL OF MAGNETIC SUSPENSION 

SYSTEMS 

SUMMARY 

For identifying a dynamic system, operating under a stochastic environment, projection 
filters, which were originally derived for deterministic systems, are developed by using 
optimal estimation theory. This newly developed system identification algorithm is 
successfully implemented at NASA Langley Research Center for identification of unstable 
large-gap magnetic suspension systems. The results show that it can be applied for 
dynamic systems under closed-loop operation with known or unknown feedback 
dynamics. The test data processed can be either in time domain or frequency domain. It is 
also very effective to be used for controller design for nonlinear unstable systems and for 
direct Kalman filter gain estimation without knowing noise covariances. 

This report summarizes the indirect closed-loop time-domain system identification 
algorithm and an iterative LQG controller redesign cycles developed for magnetic 
suspension systems. In each cycle, the closed-loop identification method is used to 
identify an open-loop model and a steady-state Kalman filter gain from closed-loop 
input/output test data obtained by using a feedback LQG controller designed from the 
previous cycle. Then the identified open-loop model is used to redesign the state feedback. 
The state feedback and the identified Kalman filter gain are used to form an updated LQG 
controller for the next cycle. This iterative process continues until the updated controller 
converges. The proposed indirect closed-loop system identification and controller design is 
demonstrated by numerical simulations and experimental results. 


1 Introduction 



Classical Linear Quadratic Gaussian (LQG) controllers are designed by solving two 
separate, but dual problems: the Linear Quadratic Regulator (LQR) design and Kalman 
filter (i.e., optimal state estimator) design. The performance of the controllers relies on an 
accurate open-loop model for the LQR and an accurate estimate of the measurement and 
process noise statistics for the Kalman filter. It is difficult to obtain an accurate model 
through analysis for some systems, and an accurate estimate of the noise statistics through 
testing for most systems. Furthermore, the noise statistics may be related to the controller 
if part of the measurement and process noise are generated by the sensor and actuator 
amplifiers, respectively. To overcome these problems, we present an iterative LQG 
controller design approach for a linear stochastic system with an uncertain open-loop model 
and unknown noise statistics. This approach consists of closed-loop identification and 
controller redesign cycles. The closed-loop identification method can simultaneously 
identify the open-loop model and the Kalman filter gain under the closed-loop operation 
with a known dynamic controller. Then the identified open-loop model is used for the 
LQR design. The LQR and the identified Kalman filter gain are used to form the updated 
LQG controller for the next closed-loop identification. The process continues until the 
updated LQG controller converges. 

For system identification, several methods (Chen et al., 1992a, 1992b, 1993; Phan et 
al., 1991; Juang et al., 1993) have been introduced recently to identify the state-space 
model of a linear system and the Kalman filter. Typically the system is under open-loop 
excitation with an uncorrelated white noise input. For an unstable system, the input/output 
data are not available while it is under an open-loop operation. To directly use these 
methods, we have to design a controller and an input signal for the closed-loop system so 
that the input signal to the open-loop system is almost white. Unfortunately, this is very 
difficult. On the other hand, some identification methods (Phan et al., 1992; Liu and 
Skelton, 1990) have been proposed recently for identifying a system under closed-loop 
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operation. However, they have several shortcomings. First, the Kalman filter gain can not 
be simultaneously identified because they are applied only for deterministic systems. In 
Phan et al. (1992), no recursive form was derived for computing the open-loop system 
Markov parameters, and in Liu and Skelton (1990), the approach is based on system pulse 
response. In this report, a recursive form for computing the open-loop system and Kalman 
filter Markov parameters is derived for stochastic systems with random excitation. 

For a system under closed-loop operation, a novel approach for identifying the open- 
loop model and Kalman filter gain is presented. First, we derive the relation between 
closed-loop state-space and AutoRegressive with eXogeneous (ARX) models for stochastic 
systems. From the derivation, it can be seen that a state-space model can be represented by 
an ARX model if the order of the ARX model is chosen large enough. Since the relation 
between the input/output data and the system parameters of an ARX model is linear, a 
linear programming approach like least-square methods, can be used for the ARX model 
parameter estimation. Second, we derive the algorithm to compute the open-loop system 
and Kalman filter Markov parameters from the estimated ARX model parameters. In this 
step, we first compute the closed-loop system and Kalman filter Markov parameters from 
the estimated ARX model parameters. Then the open-loop system and Kalman filter 
Markov parameters are computed from the closed-loop system and Kalman filter Markov 
parameters and the known controller Markov parameters. Third, the state-space model for 
the open-loop system is realized from the open-loop Markov parameters through the 
singular value decomposition method (Chen et al., 1984; Juang and Pappa, 1985). 
Finally, the Kalman filter for the open-loop system can be estimated from the realized state- 
space model and the open-loop Kalman filter Markov parameters through a least-square 
approach. 

With this closed-loop identification, an iterative LQG controller design can be 
performed. Since the Kalman filter used in this LQG controller is obtained directly from 
the closed-loop identification, it automatically takes into account the effect of the controller 
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on the noise statistics. The LQR tends to reject the process noise and the Kalman filter 
tends to filter out the measurement noise. Therefore, the closed-loop identification can 
improve the LQG design and an updated LQG controller can enhance the closed-loop 
identification in the next cycle. After a certain number of iterations, the LQG controller will 
converge. 

A similar approach is presented by Liu and Skelton (1990). As compared to that 
approach, this research has the following contributions. First, the proposed method is 
developed under the stochastic framework rather than a deterministic one. Second, the 
Kalman filter gain is also identified so that it can be used for state estimation directly. 
Third, random excitation rather than pulse response is used for the closed-loop 
identification. Finally, since the Kalman filter gain is identified, LQR state feedback is 
used rather than output feedback. Numerical and experimental results are provided to 
illustrate and validate this controller design. 

2 Closed-Loop State-Space and ARX Models Relationship 

Since the relation between the input/output data and the model parameters of a state- 
space model is nonlinear, parameter estimation of a state-space model from input/output 
data is a nonlinear programming problem. Nonlinear programming is difficult to solve in 
general and involves complex iterative numerical methods. The convergence and 
uniqueness of the solution are also not guaranteed. Unlike a state-space model, the ARX 
model has a linear relationship between its model parameters and input/output data. 
Therefore, linear programming can be used for identifying the ARX model. After 
obtaining the ARX model, a state-space model can be developed based on the relation 
between these two models. In this section, the relation between a closed-loop state-space 
model and an ARX model is derived by using z-transforms. 

A finite-dimensional, linear, discrete-time, time-invariant system can be modeled as: 

** + i =Ax k +Bu k +w k (1) 
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y k =Cx k +v k . 


(2) 


where x e R nxi , u e /?'*', y e R mxi are state, input and output vectors, respectively; w k is 
the process noise, v* the measurement noise; [.4, B, C] are the state-space parameters. 
Sequences w k and v k are assumed gaussian, white, zero-mean, and stationary with 
covariance matrices W and V , respectively. One can derive a steady-state filter innovation 
model (Haykin, 1991): 

x t+1 = Ax k + Bu k + AKe k (3) 

y k = • ( 4 ) 

where x k is the a priori estimated state, K is the steady-state Kalman filter gain and e k is 

the residual after filtering. The existence of K is guaranteed if the system is detectable and 
(i4,W 1/2 ) is stabilizable (Goodwin and Sin, 1984). The advantage of using the filter 
innovation model in the closed-loop identification is that one can directly identify the 
Kalman filter gain without estimating the covariance matrices of both process and 
measurement noise which usually are difficult to be obtained from test data (Chen and 
Huang, 1994). 

Similarly, any kind of dynamic output feedback controller can be modeled as: 

p k+ \ = A dP k + B jy k ( 5 ) 

u k = CjPk+D J y k +r k , (6) 

where A d , B d , C d , and D d are the system matrices of the dynamic output feedback 
controller, p k the controller state and r k is the open-loop input to the closed-loop system. 
Combining (3) to (6), the augmented closed-loop system dynamics becomes 

Bk + 1 = A Pk + B c r k + A c K c e k ( 7 ) 

yk=C c ri k +e k , ( 8 ) 


where 
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A. = 


A + BDjC BC d 
BjC A, , 


. B< = 


. A ^< 


AK + BD d 

B, 


,C e =[C 0], (9) 


and T] k = 



It is noted that K c can be considered as the Kalman filter gain for the 


closed-loop system and the existence of the steady-state K c is guaranteed when the closed- 
loop system matrix A c is nonsingular. Substituting (8) into (7) yields 


*?*-! =Ari k +B c r t +A r K c y t , 


( 10 ) 


where A = A c - A c K c C c and is guaranteed to be asymptotically stable because the steady- 
state Kalman filter gain K c exists. The z-transform of (10) and (8) yields 

r\(z) = (z- AY\A t .K c y{z) + B c r(z)) (11) 

y(z) = C c ri(z) + £(z). (12) 


Substituting (11) into (12), one has 

y(z) = C c (z - A T 1 (A c K c y(z) + B c r(z)) + e(z ) . 
The inverse z-transform of (13) with (z-A)"' =^A ,_l z“' yields 


(13) 


f = l 


= t,C,A'- l A c K,y t _, + J 1 C,A i -'B,r t . i + e t 


(14) 


1=1 


Since A is asymptotically stable, A' ~ 0 if i > q for a sufficient large number q. Thus 
(14) becomes 


where 


i=i 


r*— i 


+ X b i r k-> + e k 

i=i 

(15) 

ii 

JTJ 

*4 

jj 

(16) 


The model described by (15) is the ARX model which directly represents the 
relationship between the input and output of the closed-loop system. The coefficient 
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matrices a, and b i can be estimated through least-square methods from random excitation 


input r k and the corresponding output y k . 

From (15) by neglecting e k , the least-square 

problem becomes % T 
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data points. The integer l has to be large enough so that the 0 matrix has more rows than 
columns. The batch least-square solution is 

0 = (0 r 0)-‘0 r £ (17) 

Therefore, solving for an ARX model simply involves solving a linear programming 
problem involving an over determined set of equations. 

3 Markov Parameters and State-Space Realization 

In the previous section, an ARX model, which represents a closed-loop system, is 
identified from the input/output data through the least-square method. With the known 
controller dynamics, the estimated ARX model can be transformed to an open-loop state- 
space model by the following steps. First, the closed-loop system and Kalman filter 
Markov parameters are calculated from the estimated coefficient matrices of the ARX 
model. Second, the open-loop system and Kalman filter Markov parameters are derived 
from the closed-loop system Markov parameters, the closed-loop Kalman filter Markov 
parameters, and the known controller Markov parameters. Third, the open-loop state-space 
model is realized by using singular-value decomposition for a Hankel matrix formed by the 
open-loop system Markov parameters. Finally, an open-loop Kalman filter gain is 
calculated from the realized state-space model and the open-loop Kalman filter Markov 
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parameters through least-squares. 

The z-transform of the open-loop state-space model (3) yields 

x(z) = (z-A)-'(Bu(z) + AKe(z)). (18) 

Substituting (18) to the z-transform of the output equation (4), one has 

y(z) = C(z - A)~' ( Bu(z ) + AKe(z)) + £(z) 

= £ Y(k)zMz) + X m)z~ k £(z), ( 1 9) 

k= 1 *=() 

where Y(k ) = CA k ~ ] B are the open-loop system Markov parameters; N(k) = CA k ~ ] AK, for 
k = 1,L ,°o, open-loop Kalman filter Markov parameters, and N(0) = I which is an 
identity matrix. Similarly, for the dynamic output feedback controller (5) and (6) and the 
closed-loop state-space model (7) and (8), one can derive 

u(z) = '£ l Y J (k)z~ k y(z) + r(z) (20) 

k=0 

y(z) = ^Y c (k)z~ k r(z) + ^N c (k)z~ k £{z), (21) 

k = 1 k = 0 

where Y d (0) = D d , and Y d (k) = C d A d k ~ l B d , for & = 1,L ,oo, are the controller Markov 
parameters; Y c (k) = C c A c k ~ t B c the closed-loop system Markov parameters; and N c ( 0) = /, 
N v (k) = C c A k ~' A C K C , for k = 1,L ,°°, the closed-loop Kalman filter Markov parameters. 

Closed-Loop System and Kalman Filter Markov Parameters. The z- 

transform of the ARX model (15) yields 

f <* A </ 

/ — XL y(z.) = ^ d b i z~'r(z) + £(z). (22) 

V i=i / i=i 

Applying long division to (22), one has 

y(z) = (b l z~' + (b 2 + a^z" 2 + (fe, + a { (b 2 + a x b { ) + a 2 b x )z~ y +...)r(z) + 
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(7 + a,z 1 +(a,a, +a 2 )z 2 +(a,(a,a 1 + a 2 ) + a,a, +a 3 )z 3 +...)e(z). 

After comparing with (21), the closed-loop system and Kalman filter Markov parameters 
can be recursively calculated from the estimated coefficient matrices of the ARX model, 

(23) 

i=i 

N c (k)^ ai N c (k-i). (24) 

1 = 1 

It is noted that y t .(0) = 0, N t (0) = /, and a i = b i = 0, when i>q. One may obtain (23) 
and (24) from (16) and the definition of the Markov parameters (Phan et al., 1991 ; Juang et 
al., 1993). However, the derivation is much more complex. 


Open-Loop System and Kalman Filter Markov Parameters. Next, the open- 
loop system and Kalman filter Markov parameters can be derived from the closed-loop 
system Markov parameters, the closed-loop Kalman filter Markov parameters, and the 
known controller Markov parameters. Substituting (20) into (19) yields 

f — \( ~ ~ ~ 


y(z)= XW)z‘* XWz‘*y(z) +^Y(k)z- k r(z) + ^N(k)z- k e(z) 


,k = \ 


A*= o 


J k=\ 


k = 0 


= X a*z"‘y(z) +X Y (k)z~ k r(z) +X N(k)z- k e(z ) , 


(25) 


*= 1 


* = 1 




k 

where a k = ^ Y(i)Y d (k - i). Rearranging (25), one has 
1 = 1 


( 

V 



y(z) = J j Y(k)z- k r(z)+^N(k)z- k e(z). 

) Jt=l Jk =0 


(26) 


Similarly, one can apply long division to (26), and then compare it with (21), to describe 
the closed-loop system Markov parameters recursively in terms of the open-loop system 
and the controller Markov parameters, 
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(27) 


Y e U) = Y(j) + X a k Y, U -k) = Y(j) + X X Y(i)Y/k - i)Y e (j -k). 

1=1 a=i (=i 

And the closed-loop Kalman filter Markov parameters can be recursively expressed in 
terms of the open-loop system Markov parameters, the open-loop Kalman filter Markov 
parameters, and the controller Markov parameters as following: 

N e U) = NU) + X <*k N cU - k ) = N U) + XX Y{i)Y d {k - i)N.(j - k). (28) 

i=i 1=1 i=i 

Rearranging (27) and (28), one has 

YU) = Y C U) ~ 'ti,Y(i)Y d (k - i)Y c U ~ k) (29) 

k = 1 r=l 

N(j) = KU) -XX Y{i)Y d {k -i)N c U ~ k). (30) 

1=1 i=i 

Equations (29) and (30) show that one can recursively calculate the open-loop system and 
Kalman filter Markov parameters from the closed-loop system Markov parameters in (23), 
the closed-loop Kalman filter Markov parameters in (24), and the known controller Markov 
parameters Y d (k) = C d A d k ~'B d . It is noted that ^(0) = 0 and N t .(0) = I. One can easily 

verify (29) and (30) from (9), and also from the definition of the Markov parameters. 

Slate-Space Realization. The open-loop state-space model can be realized from 
the open-loop system Markov parameters through the Singular Value Decomposition 
(SVD) method (Chen, 1984; Juang and Pappa, 1985). The first step is to form a Hankel 
matrix from the open-loop system Markov parameters, 

Y(j) Y(j + 1) L Y(j+P) 

Y(j + 1) TO' + 2) L TO + 0 + 1) 

M MOM 

TO + y) TO'+y+l) L YU + r + P) 

where Y(j) is the j -th Markov parameter. For a noise free system, if the arbitrary integers 
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(3>n, and y > n (the order of the system), the Hankel matrix H(j) is of rank n . From 
the measurement Hankel matrix, the realization uses the SVD of H( 1), H( 1) = ULV T , to 
identify a n -th order discrete state-space model as 


A = Z' U2 U T H(2)V X~ 1/2 , B = I u 2 V t E , C = E T U I 1 ' 

v ' n n ’ n n s ’ m n n 


J / 2 


(32) 


where matrix is the upper left hand nxn partition of X containing the n largest 
singular values along the diagonal. Matrices U n and V n are obtained from U and V by 

retaining only the n columns of singular vectors associated with the n singular values. 
Matrix E m is a matrix of appropriate dimension having m columns, all zero except that the 
top mxm partition is an identity matrix. E s is defined similarly. 


Open-Loop Kalman Filter Gain. Once the open-loop A and C are obtained, one 
can easily calculate the open-loop Kalman filter gain from the open-loop Kalman filter 
Markov parameters N(k) = CA k K in a least-square sense as follows 


k = (O t oy 1 o t 


~N( 1 )' 


' C A' 


, where 0 = 

; 

_N(k). 


1 

*7 

1 


(33) 


The integer k has to be large enough so that the matrix O has more rows than columns. 
The identified Kalman filter gain can be used directly for state estimation. 

4 Iterative LQG Controller Design 

Classical LQG controllers are designed by solving two separate, but dual problems: the 
LQR design and Kalman filter design. Here, the Kalman filter gain can be simultaneously 
obtained with the open-loop state-space model through the closed-loop identification. Only 
the LQR design based on the identified open-loop model needs to be solved. The 
performance index for the LQR problem is defined as 

PI = ±y!Qy k +u l Ru t = Y, x l cT Q Cx k +«[*«* 

*=1 *=l 
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( 34 ) 



where weighting matrices Q and R are design parameters. We can summarize the iterative 

LQG controller design as follows: 

1 . Use the a priori open-loop model and arbitrary covariance matrices of the measurement 
and process noise to design the LQR and Kalman filter. Then, calculate the controller 
Markov parameters. The weighting matrices Q and R for the LQR chosen here will 
remain the same in the following iterations. 

2. Apply random excitation input to the closed-loop system and record the closed-loop 
input/output data. 

3. Estimate the coefficient matrices of the closed-loop ARX model by using (17). 

4. Calculate the closed-loop system and Kalman filter Markov parameters by using (23) 
and (24). 

5. Calculate the open-loop system and Kalman filter Markov parameters by using (29) 
and (30). 

6. Realize the open-loop state-space system matrices B, cj by using (31) and 
(32). 

7. Estimate the open-loop Kalman filter gain K by using (33). 

8. Obtain the LQR feedback gain F by solving the corresponding Riccati equation based 
on the identified open-loop model. 

9. Form the updated LQG controller in (5) and (6) by using A d = A — BF - AKC , 
B d - AK , C d = —F, and D d = 0. 

1 0. Calculate the updated controller Markov parameters and check the convergence of the 
controller by 

S = ill r w (* W - X ,<«,™.,| 2 • < 35 > 

*=o 

If 6 is greater than a desired value, go back to step 2, otherwise stop. 
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5 Numerical and Experimental Example 


The proposed iterative LQG controller design has been applied to control design of the 
Large-Angle Magnetic Suspension Test Facility (LAMSTF) (Groom and Britcher, 1992; 
Groom and Schaffner, 1990) developed in NASA Langley Research Center (see Fig. 1). 
The LAMSTF is a laboratory-scale research project to demonstrate the magnetic suspension 
of objects over wide ranges of attitudes. This system represents a scaled model of a 
planned Large-Gap Magnetic Suspension System. The LAMSTF system consists of a 
planar array of five copper electromagnets which actively suspend a small cylinder with a 
permanent magnet core. The cylinder is a rigid body and has six independent degrees of 
freedom, namely, three displacements (x, y and z) and rotations (pitch, yaw and roll). 
Currents in the electromagnets generate a magnetic field which produces a net force and 
torque on the suspended cylinder. The roll of the cylinder is uncontrollable, and is 
assumed to be motionless. Five pairs of the LEDs and light receivers are used to indirectly 
sense the pitch and yaw angles, and three displacements of the cylinder's centroid. 
Therefore, the control inputs to the system consist of five currents sent into five 
electromagnets and the system outputs are five voltage signals measured from five photo 
detectors. The forces on the cylinder are, in general, non-linear functions of space and 
current. Therefore, only the linear time-invariant perturbed motion about an equilibrium 
state is considered. Because it is difficult to accurately model the magnetic field and its 
gradients, the analytical model contains some modeling errors. Therefore, the performance 
of the LQG controller based on the analytical model alone is unsatisfactory. 

The system matrices of the analytical model are shown in the appendix. The 
eigenvalues of the system matrix indicate that the LAMSTF system includes highly unstable 
real poles (about 10 Hz) and low-frequency oscillatory modes (about 0.16 Hz). For both 
numerical simulation and experiment, the sampling rate is 250 Hz. The performance index 
used for the LQR design is also shown in the appendix. The step command for all 
simulations and experiments is 0.02 radian for pitch and yaw, and 0.2 mm for x, y, and z. 
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In the numerical simulation, the analytical model is used as the true model. In each 
iteration, the ratios of the process and measurement noise to the corresponding signal are 
2% and 1%, respectively. To simulate modeling error and unknown noise statistics, the 
initial LQG controller is designed by using an altered model of which each parameter is 5% 
greater than the corresponding parameter of the analytical model and guessed covariance 
matrices of noise W = 1 0/ 10xl0 and V = / Jx5 . The simulated step response with this initial 

controller for the pitch, yaw, x, y, and z is shown in Fig. 2. It is clear that the result is 
very poor. After performing the first iteration of the proposed iterative LQG controller 
design, the step response shown in Fig. 3 is greatly improved. The performance is further 
improved slightly in the following iterations. Figure 4 shows how the controller converges 
by comparing the (1 ,1 ) element of the controller Markov parameters. 

For a noise free system, the exact open-loop model can be obtained after the first 
closed-loop identification and no further iteration is required. In this case, the identified 
Kalman filter gain becomes the dead-beat observer gain (Phan et al., 1991; Juang et al., 
1 993). For a noise corrupted system, iterations are required to update the open-loop model 
and the Kalman filter gain until the iterative LQG controller converges. Although the 
numerical simulations show that the iterative controller can converge quickly, the required 
conditions to guarantee the convergence need further study. 

In the experiments, the analytical model and guessed covariance matrices of noise 
W = 10/ 10xl0 and V = / SxJ are used to design the initial LQG controller. The experimental 

step response with this initial controller is also very poor. The experimental step responses 
for the first three iterations are compared in Fig. 5 to demonstrate how the step response is 
improved with iteration. In each iteration, the open-loop system model and the Kalman 
filter gain are updated through the closed-loop identification from experimental data. The 
experimental step response improves with each iteration, similar to the simulated cases. 
The experimental steady-state errors, however, do not go to zero in each case. This is due 
to drift in the sensor zero between experiments. The system's dynamics have been found 
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to be insensitive to these small changes in the operating point. The results show that the 
proposed iterative LQG controller design is very effective for controlling this highly 
unstable magnetic suspension system. 

6 Conclusion 

In contrast to most existing LQG controller designs of which the great majority solve 
two separate, but dual problems: the LQR and Kalman filter design, this report proposes an 
iterative LQG controller design approach. A closed-loop identification method is developed 
to update the open-loop state-space model and the Kalman filter gain simultaneously from 
the closed-loop input/output test data. The method is derived under the stochastic 
framework, taking into account the effects of process noise as well as measurement noise. 
For a noise free system, the exact open-loop model can be obtained after the first closed- 
loop identification and the identified Kalman filter gain becomes the dead-beat observer 
gain. For a noise corrupted system, iterations are required to update the open-loop model 
and the Kalman filter gain from testing until the iterative LQG controller converges. In 
each iteration, since the Kalman filter gain is identified directly from test data, the LQG 
design is simplified to be an LQR design. A highly unstable large-angle magnetic 
suspension system is used to validate this controller design. Both numerical simulations 
and test data show that the controller converges quickly and is very effective when the 
system is subjected to modeling error and unknown noise statistics. 
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Appendix 


The analytical model of the large-angle magnetic suspension test facility is 


x = Ax + Bu 

rtt m 

(Al) 

y = c m x 

(A2) 
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where x = 1 / 1, A m = 5x5 5x5 ,B = 5x5 and C =[C, 0, x5 l. The state variable 

KJ m L a 21 A 22 J m [b 2 \ 1 5x5j 

x includes pitch and yaw angles and three linear displacements of the cylinder's centroid. 
The matrices A 21 , A 22 , 5 2 and C, are 

’ 3.3415e + 03 0 -3.9392^ + 04 4.9534c- 12 2.0811c- 12 

0 3.3415c + 03 -4.9534c-12 4.8609c-12 -1.4472c- 11 

A 21 = -9.8070c + 00 -2.4664e - 15 4.9937^ + 01 4.3604^-15 -2.5089c-02 

-3.6031c- 15 1.9618c- 15 4.3604^-15 9.5577c + 01 -9.0007^-15 

-2.3357c- 16 -3.6031c- 15 -2.5089^-02 -9.0007c-15 -9.1324c -01 

^22 = ^5x5’ 

’ 3.8370c + 01 3.8370c + 01 3.8370^ + 01 3.8370c + 01 3.8370^ + 01 

0 8.9802c + 01 5.5514e + 01 -5.5514c + 01 -8.9802c + 01 

B 2 = 2.2144c - 01 -1.5274c -01 7.8453^-02 7.8453^-02 -1.5274c -01 

0 1.21 54c — 01 —1.9674c - 01 1.9674c-01 -1.2154c-01 

-2.7672c - 01 -8.5465c - 02 2.2388c-01 2.2388c-01 -8.5465c-02 

0 0 0 6.0976c + 03 

0 7. 8740c + 03 0 0 

0 0 0 6. 2500c + 03 

9.5425c + 01 0 -6.5359c + 03 0 

-1.0725c + 02 0 -5. 1 8 1 3c + 03 0 

The eigenvalues of the system matrix A m are ±58.78, ±57.81, ±9.78, ±jl.91 , and 
± y'0.96 . The matrix C, which relates the sensor output voltage to the displacement can be 

obtained from calibration and is assumed known. To recover the displacement from the 
sensor output voltage, one can use x p = C^'y. 

The performance index for the state feedback design is chosen as 

P.I.= ^ylQy k +u T k Ru k (A3) 

k = \ 

where Q = (C, ~ l ) T diag\\.e3 l.c3 2.c8 2.c8 2.C8JC, -1 and R = / 5x5 . 
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Fig. 4 Comparison of the ( 1 , 1 ) element of the controller Markov parameters 

Yj(k) = 
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